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(54) Real-time image-guided placement of anchor devices 



(57) A real-time Positioning system monitors and 
displays a real-time position and orientation (pose) of a 
Surgical device (25) relative to reference device (27) 
and internal structures of a subject during a medical pro- 
cedure Tracking targets (28) are affixed to a surgical 
device (25) and a reference device (27). The reference 
device is fixed to a target site of a subject. The tracked 
targets are interactively monitored by a tracking device 
(13) and their raw positions are converted (15) to a po- 
sition and orientation (pose) of the surgical device and 
the reference device. A medical imaging device (11 ) ac- 



quires images of internal structures of the subject which 
is converted into computer models by a modeling engine 
(1 7). The models of internal structures are correctly reg- 
istered with models of the surgical instrument and the 
reference device into a single interactive representation 
assisting a surgeon in a medical procedure. A trajectory 
planner (23) may be employed to select a best path 
through a subject based upon user defined criteria, such 
as greatest overall density, least density, furthest from 
nerves, blood vessels : intersecting. the most diseased 
tissue, etc. 
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Description 

[0001] The present invention relates to medical pro- 
cedures in which a device is inserted into specified lo- 
cations within a subject. s 
[0002] In various medical procedures, it is necessary 
to attach a piece of medical equipment into a solid struc- 
ture of the subject. 

[0003] Typically, screws are inserted into vertebra on 
both ends of a structurally-compromised vertebrae to 
provide support while a spinal fusion is being created. 
Fractures in the spine and in other bones are also held 
together with a screw or similar implant. 
[0004] In the case of abnormal spinal structure, it may 
necessary to fasten a support structure to correct or 
straighten a subject's spine. 

[0005] These examples require precise insertion of a 
screw or pin into bone of the subject. 
[0006] Typically, these pins or screws have been in- 
serted by a surgeon who visually, or by feel', finds the 
approximate location where the screw or pin should be 
entered, and drills a hole at that location. The screw or 
pin is inserted into the hole. 

[0007] Sometimes, during surgery, two dimensional 
(2D) snapshots such as x-rays or magnetic resonance 
(MR) images may be obtained. 
[0008] Since these are 2D in nature, it may be difficult 
to extrapolate the image plane to the plane allowing the 
access of insertion of the screw. 
[0009] Since the surgeon would also like to make as 
small an incision as possible, many times the target area 
is obscured by muscle or other tissue and the surgeon 
approximates the location of the actual target point. 
[0010] Location of the target location may be further 
obscured by blood profusion in the area, further compli- 
cating identification of the target point. 
[0011] Once the approximate location is determined, 
the surgeon has little information as to the relative 
strength and thickness of the bone in the area in which 
the pin or screw is to be inserted. 
[0012] Also, while applying these screws and pins, it 
is possible that the surgeon punctures or severs major 
arteries, veins, or nerves which may be hidden inside 
tissue over the target structure, or lie behind the target 
structure, not visible to the surgeon. 
[0013] Currently there is a need for a device which ac- 
curately indicates an optimum insertion point, orienta- 
tion angle, and depth for surgical screws and pins. 
[0014] A real-time positioning system aids a medical 
practitioner in accurately manipulating a surgical instru- 
ment to a precise position and orientation (pose) with 
respect to internal structures of a subject during a med- 
ical procedure. 

[0015] The interactive positioning system employs 
tracked targets fixed to known locations of the surgical 
instrument and a reference device. 
[0016] The reference device is attached to a desired 
target site on the subject. 



[0017] A tracking device interactively tracks the raw 
location of the targets. 

[0018] The raw location of the targets are converted 
into a pose of the surgical instrument and the reference 
device by a transform device coupled to the tracking de- 
vice. 

[0019] A medical imaging device is coupled to the 
transform device for receiving the pose of the surgical 
instrument and the reference device, and for acquiring 
volumetric imaging data internal structures of said sub- 
ject near the location of the reference device. 
[0020] A segmentation device coupled to the medical 
imaging device, receives the volumetric imaging data. 
It then identifies each segmented structure. A segment- 
ed structure is the set of contiguous locations in the im- 
aging data having the data values within a predefined, 
or user-supplied range. The segmentation device cre- 
ates models of the segmented structures selected by 
the user from the volumetric imaging data. 
[0021] A modeling engine provides computer models 
of the reference and surgical devices. These may be 
predefined and stored. 

[0022] A renderer device is coupled to the transform 
device and receiving the pose of the surgical device, and 
the reference device. It then interactively adjusts the 
pose of the computer models of the surgical and the ref- 
erence devices for correct registration with models of 
the internal structures. It creates a display signal which 
is displayed to the user by a user interface. The user 
may also interact with the user interface to show or hide 
different internal structures. The user may also use the 
user interface to provide imaging, viewpoint or other us- 
er-supplied parameters into the system. 
[0023] A trajectory planner may be employed which 
is coupled to a user interface. This allows the user to 
select a proposed region to use the surgical device. The 
user may also interact with trajectory planner to select 
a best pose for the medical instrument, and provide a 
visual representation superimposed upon the image of 
the surgical and reference devices and the internal seg- 
mented structures of the subject. 
[0024] The user interacts with a user interface to se- 
lect criteria for the best path. The criteria may require a 
path to be furthest from blood vessels, diseased tissue, 
hematoma, areas of reduced circulation, etc. 
[0025] The user-defined criteria may also be finding 
a path with the greatest (or least) overall tissue density. 
Possible paths within a user-defined localized region 
are searched with an integration along each of the paths 
compared to find the highest (or lowest) density as the 
best path. This feature may become important for med- 
ical procedures, such as inserting fasteners at a pose 
which results in the greatest holding force. 
[0026] It is an object of the present invention is to pro- 
vide a device which interactively tracks the position and 
orientation of a reference device and an axis and tip of 
a surgery device and provides a visual representation 
of the relative locations and orientations of the reference 



15 



20 



25 



30 



35 



40 



45 



50 



3 



EP 0 908 146 A2 



4 



device, surgical device and important structures of the 
subject. 

[0027] Another object of the present invention is to 
provide a visual guide of a tip and access of the surgical 
device relative to a reference device attached to a living 
subject. 

[0028] Another object of the present invention is to 
provide real-time image-guided placement of surgical 
screws or pins in a living subject. 
[0029] The features of the invention believed to be 
novel are set forth with particularity in the appended 
claims. The invention itself, however, both as to organ- 
ization and method of operation, together with further 
objects and advantages thereof, may be best under- 
stood by reference to the following description taken in 
conjunction with the accompanying drawing in which: 
Figure 1 is a simplified block diagram of one embodi- 
ment of the present invention in operation tracking the 
location of a surgical device relative to a desired location 
within a subject. 

[0030] The present invention operates by providing a 
computer graphic image indicating the position and ori- 
entation (pose) of a therapy device relative to a refer- 
ence device fixed with respect to a subject 1 . The ther- 
apy device, and reference device are correctly regis- 
tered with images of internal images of subject 1 . One 
type of therapy device is a surgical drill, which a user 5, 
preferably a surgeon manipulates. 
[0031] A tracking device 1 3 employs a tracking device 
1 3 which tracks tracking targets 28 located on a therapy 
device 25 and a reference device 27. In one embodi- 
ment of the present invention, a Science Accessories 
model GP-12XL digitizer was used. This type uses 
sound transmitters as tracking targets 28. Tracking de- 
vice 1 3 employs a receiver 29 located and other elec- 
tronics capable of calculating the instantaneous dis- 
tance between each of the tracked targets 28. 
[0032] At least three tracked targets 28 are required 
on each of therapy device 25 and reference device 27 
in order to uniquely determine their pose. 
[0033] A medical imaging device 11 acquires images 
of subject 1 and reference device 27 in the form of vol- 
umetric data which is passed to a modeling engine 17. 
[0034] Medical imaging device 1 1 may be a computed 
tomography (CT), magnetic resonance (MR), ultra- 
sound, or positron emission tomography (PET) imaging 
device. Other types of medical imaging device may also 
be used which provide an image of internal organs of 
subject 1 and can provide an image of tracked targets 
28. 

[0035] Medical imaging device 11 is connected to a 
transform device 15 which takes the coordinates from 
tracking device 13 and provides absolute pose of the 
reference device 27 and surgical device 25 from the raw 
locations of each of the tracked targets 28. The absolute 
locations of the reference device 27 may be used then 
by the medical imaging device 11 to obtain an image 
with the reference device 27 in the field-of-view and at 



a desired image plane angle. 
[0036] Tracking device 13 is explained here using 
sound and t ime-of -fl ight technology to locate the therapy 
device 25 and reference device 27, however, other 

s tracking means employing radio frequency (RF) track- 
ing, MR tracking, or laser light interferometry tracking 
which are commonly used and known may be em- 
ployed. Please note that a laser imaging and tracking 
device may be used only if there is a a clear line-of-sight 

10 between tracked targets 28 and tracking device 1 3. 
[0037] An optical tracking device which may be used 
is that which is manufactured by Ascension Technology 
Corporation and Leica Corporation. 
[0038] RF tracking is described in U.S. patent 

is 5,443,066, August 22, 1995 by Dumoulin, Darrow; 
5,445,150, August 29 : 1995 by Dumoulin and Darrow. 
[0039] MR tracking is described in U.S. patent 
5,307,808, May 3, 1994 by Dumoulin, Darrow; 
5,271,400, December 21, 1993 by Dumoulin, Souza, 

20 Darrow; and 5,31 8,025, June 7, 1994 by Dumoulin, Dar- 
row. 

[0040] Therefore, various types of tracking devices 1 3 
may be used with their associated tracked targets. In 
the case of MR tracking the target may be an MR active 

25 source, or an RF transmitter coil. 

[0041] For RF tracking the tracked target may be an 
RF coil which either transmits or receives RF energy. 
[0042] For laser distance measurement, the tracked 
target may be a laser reflective target, such as a comer 

30 cube reflector. 

[0043] The present invention may be constructed in 
several different embodiments depending upon the 
speed and smoothness of imaging required and the 
complexity and power required of processing elements 

35 of the system. 

[0044] In a basic embodiment, icons representing the 
therapy device 25 and reference device 27 are pre- 
stored in modeling engine 17 are displayed on a user 
interface 1 9 in their proper pose. For example, if therapy 

40 device 25 is a surgical drill, a representation of the lo- 
cation of the tip of the drill and an axis from the tip of the 
drill through the drill bit uniquely defined the pose of the 
drill. 

[0045] A reference device 27 which may be a triangu- 
45 tar flat object, may be illustrated as a triangular flat plane 
having the proper pose. 

[0046] In a more sophisticated embodiment, therapy 
device 25 and reference device 27 may be defined as 
a three dimensional surface model and provided to mod- 

50 eling engine 1 7, or be pre-stored in modeling engine 1 7. 
This allows modeling engine 17 to provide a view from 
a given viewpoint of either ol these devices. This, of 
course, requires more processing power and more time. 
[0047] A segmentation device 14 interacts with the 

55 volumetric imaging data from medical imaging device 
11, and determines data values within a predefined 
range, or a range interactively defined by user 5 via in- 
terface 1 9. These values are used to define a tissue 
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type. Next contiguous locations having the same tissue 
type are determined. The set of all contiguous locations 
of the same tissue type are treated as a solid structure. 
This information is passed to renderer 21. 
[0048] Conventional segmentation may be used, * 
such as that described in U.S. patent 5,187,658, Febru- 
ary 16, 1993 by Cline, and Lorensen. 
[0049] User 5 may interact with user interface 1 9 to 
specify imaging parameters to modeling engine 17 and 
a renderer 21 , such as the viewpoints from which to view 
the model. 

[0050] User 5 may interact with renderer 21 through 
user interface 1 9 to select different modes, such as one 
that user 5 is allowed hide selected segmented struc- 
tures, effectively 'stripping away* layers of tissue reveal- 
ing deeper surfaces of internal structures. Conversely 
user 5 may show more superficial structures until the 
most superficial surface is shown. 
[0051] The segmented models may then be provided 
to a renderer 21. 

[0052] The images and models of subject 1 have to 
be coordinated with the models of therapy device 25 and 
reference device 27. Tracking device 1 3 tracks the lo- 
cations of targets 28 and provides an absolute location 
with respect to the tracking device coordinate system. 
Medical imaging device 11 images targets 28 and pro- 
vides relative locations, relative to the imaging scanner 
coordinate system. The relative locations are offset by 
renderer 21 to correspond to the locations of targets 28 
from tracking device 13. This causes all models to be- 
come registered. 

[0053] Other automated techniques such as a least 
squared error minimization of at least three points com- 
mon to both of the systems may be used to register the 
locations measured by tracking device 1 3 to those of the 
medical imaging device 11. 

[0054] The locations measured by tracking device 1 3 
are combined with known information of the geometry 
of therapy device 25 and reference device 27 pre-stored 
in transform device 1 5 to determine the absolute pose 
of reference device 27 and therapy device 25. This in- 
formation is provided to renderer 21 to rotate and trans- 
late reference device 27, therapy device 25 and the seg- 
mented images of subject 1 to their proper locations and 
orientations relative to each other An image is provided 
to user 5 through user interface 19. 
[0055] User 5 interacts with a user interface 1 9 to se- 
lect criteria for the best path. The criteria may require a 
path to be furthest from blood vessels, diseased tissue, 
hematoma, areas of reduced circulation, etc. User 5 
may then indicate on a screen of user interface 19 with 
a pointing device, such as a mouse, a region in which 
operator 5 wishes to examine along with an intended 
orientation. This may be in the form of a ray through the 
segmented structure. This region is searched to deter- 
mine a ray which most closely fits the specified criteria, 
such as having the greatest cumulative distance from a 
vessel. 



[0056] The user-defined criteria may also require find- 
ing a path with the greatest (or least) overall tissue den- 
sity. A trajectory planner 23 is coupled to modeling en- 
gine 17 and receives the volumetric imaging data for a 
segmented structure selected by user 5. User 5 selects 
a local region to test. Trajectory planner 23 then search- 
es pose of a plurality of rays integrating tissue density 
along each of the rays in the defined region identifying 
a ray which has highest density integral along the por- 
tion of a ray which an attachment device will traverse. If 
several exist, the closest to the orientation may be pro- 
vided first. 

[0057] One method which trajectory planner 23 deter- 
mines the most solid tissue is by going back to the vol- 
umetric data for the selected segmented structure and 
integrating the data intersected by each ray. For CT 
scans this is very straightforward since the data is in- 
versely proportional to tissue density. 
[0058] In other types of medical imaging data, the da- 
ta must first be adjusted to indicate tissue density. The 
imaging parameters may also be altered in order to ac- 
quire volumetric data indicating tissue density, and the 
procedure repeated with the new data. Not all medical 
imaging modalities may be suitable for optional density 
integrator 23 to operate. 

[0059] Once the present invention is in operation, re- 
al-time tracking of internal structures of subject 1, refer- 
ence device 27 and therapy device 25 are imaged on 
user interface 1 9 visible to user 5. User 5 may then in- 
teractively position the therapy device 25 to make it co- 
incide with a proper pose indicated visually on user in- 
terface 19. This location has been pre-stored or has 
been previously calculated by trajectory planner 23. 
[0060] In an embodiment employing a surgical drill, 
the present invention not only monitors the precise lo- 
cation to drill and the orientation, but may also indicate 
the proper depth. This indicate may be superimposed 
on the images, or alternatively an alarm or monitoring 
system may be activated indicating that the proper 
depth has been reached. 



Claims 

1. A real-time positioning system for accurately posi- 
tioning and orienting a surgical instrument (25), at 
a precise position and orientation (pose) with re- 
spect to internal structures and a target site of a sub- 
ject (1) during a medical procedure, comprising: 

a) a reference device (27) fixed with respect to 
said target site of said subject 

b) tracked targets (28) fixed to known locations 
of said surgical instrument (25) and the refer- 
ence device (27); 

c) a tracking device (13) for interactively track- 
ing the raw location of the tracked targets (28); 

d) a transform device (1 5) coupled to the track- 
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ing device (13) for converting the raw locations 
of the tracked targets (28) into a pose of the 
surgical instrument (25) and the reference de- 
vice (27); 

e) a medical imaging device (11) coupled to the s 
transform device (15) for receiving the pose of 
the surgical instrument (25) and the reference 
device (27), and for acquiring volumetric imag- 
ing data of said target site, reference device 
(27), tracked targets (28), and internal struc- io 
tures of said subject; 

f) a modeling engine (17) for providing compu- 
ter models of the reference and surgical devic- 
es; 

g) a segmentation device ( 1 4) coupled to med- is 
ical imaging device (11) for creating computer 
models of contiguous locations in the volumet- 
ric imaging data having the data values within 

a predetermined, or user-defined, range indi- 
cating the same tissue type, being a segmented 20 
structure and for identifying surfaces between 
tissue type; 

h) a renderer coupled to the segmentation de- 
vice (14), the modeling engine (17), and the 
transform device (15) for receiving the pose of 25 
the surgical device (25) and the reference de- 
vice (27), and for interactively creating a display 
signal of these computer models in their appro- 
priate pose in correct registration with models 

of the internal structures. 30 

2. The real-time positioning system recited in claim 1 , 
further comprising: 

a user interface coupled to the segmentation 
device (14), the modeling engine (1 7), the medical 3S 
imaging device (11) and the renderer (21) for pro- 
viding user-defined parameters to these devices; 
and 1or displaying the display signal from the ren- 
derer (21) to the user. 

40 

3. The real-time positioning system recited in claim 1 , 
further comprising: 

a trajectory planner (23) coupled to the mod- 
eling engine (1 7), the segmentation device (1 5) and 
the user interface device (1 9), for receiving the vol- 45 
umetric data from the segmentation device (14) for 
each user-defined segmented structure, and a us- 
er-defined region to search, and searching the user- 
delined region for a ray which best matches user- 
defined criteria. so 



er-defined region to search, and integrates the vol- 
umetric data indicating total tissue density, for each 
of a plurality of rays identifying maxima or minima 
in the region. 

5. The real-time positioning system recited in claim 1 , 
wherein: 

a) the tracked targets (28) comprise sonic en- 
ergy emitters; and 

b) the tracking device (13) comprises a sonic 
tracking device capable of tracking the loca- 
tions of sonic energy emitters. 

6. Ale real-time positioning system recited in claim 1 , 
wherein: 

a) the tracked targets (28) comprise radiofre- 
quency (RF) energy emitters; and 

b) the tracking device (13) comprises an RF 
tracking device capable of tracking the loca- 
tions of RF energy emitters. 

7. The real-time positioning system recited in claim 1 , 
wherein: 

a) the tracked targets (28) comprise magnetic 
resonance (MR) coils; and 

b) the tracking device (1 3) comprises an MR im- 
aging device capable of tracking the locations 
of the MR coils. 

8. The real-time positioning system recited in claim 1 , 
wherein: 

a) the tracked targets (28) comprise light reflec- 
tors; and 

b) the tracking device (13) comprises a light 
source capable of tracking the locations of light 
reflectors. 



4. The real-time positioning system recited in claim 1 , 
further comprising: 

a trajectory planner (23) coupled to the mod- 
eling engine (17), the segmentation device (1 4) and ss 
the user interface device (1 9), for receiving the vol- 
umetric data from the segmentation device (14) for 
each user-defined segmented structure, and a us- 
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